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Abstract. We introduce a stochastic version of the classical Perron's method 
to construct viscosity solutions to linear parabolic equations associated to sto- 
chastic differential equations. Using this method, we construct easily two vis- 
cosity (sub and super) solutions that squeeze in between the expected payoff. 
If a comparison result holds true, then there exists a unique viscosity solution 
which is a martingale along the solutions of the stochastic differential equa- 
tion. The unique viscosity solution is actually equal to the expected payoff. 
This amounts to a verification result (Ito's Lemma) for non-smooth viscosity 
solutions of the linear parabolic equation. 



1. Introduction 

The best way to approach a Feynman-Kac equation (or a Hamilton- Jacobi- 
Bellman equation in the case of stochastic control) is to prove existence of a smooth 
solution and then use Ito's Lemma to relate it to the corresponding probabilistic 
representation. In case such a smooth solution does not exist, a large number of 
results in the literature consist in taking the expected payoff (value function) associ- 
ated to a Markov diffusion and then checking the viscosity solution property. Such 
an approach essentially uses the Markov property of the diffusion. If uniqueness in 
law of the stochastic differential equation does not hold, then a Markov selection is 
needed to obtain a viscosity solution this way. If, in addition, a viscosity compar- 
ison result holds true (which is a purely analytical result), then the conclusion is 
that the expected payoff (value function) is actually the unique viscosity solution. 

On the other hand, Ishii [2] refined the classical Perron's method to the case 
of viscosity solutions. This amounts to a very powerful analytical method to con- 
struct (therefore proving existence) viscosity solutions in very general frameworks. 
However, if one wants to compare such a viscosity solution obtained by Perron's 
method with the expected pay-off (value function), then one still needs the viscos- 
ity property for the expected pay-off (value function). In other words, the program 
described in the beginning still needs to be carried out. 
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In this note, we propose a stochastic alternative to Perron's method to con- 
struct viscosity solutions, namely Theorem 12.11 More precisely, we consider the 
infimum of stochastic super-solutions or the supremum of stochastic sub-solutions 
to a linear parabolic PDE. By stochastic sub and super-solutions we mean obvious 
generalizations of the seminal notion of stochastic solution introduced by Stroock 
and Varadhan [5 . To the best of our knowledge, such a technique does not exist 
in the literature. While this construction does not provide a stochastic solution, 
it does provide a (weaker) viscosity solution. The main advantage of our method 
is that comparison between such constructed viscosity solutions and the expected 
pay-off (value function) becomes trivial (see Lemma |2.1[) . because it is imbedded in 
the stochastic definition. In other words, one does not need to prove any property 
for the expected pay-off (value function) in order to compare it to the viscosity 
solution(s) constructed by stochastic Perron's method. Using this result, if viscos- 
ity comparison holds, then one gets that the unique viscosity solution is actually 
equal to the expected pay-off (value function) for free. The unique viscosity solu- 
tion is a martingale along any solution of the stochastic differential equation, i.e. 
is a stochastic solution in the sense of Stroock and Varadhan [5]. This actually 
amounts to a verification result for non-smooth viscosity solutions, where we can 
use uniqueness of viscosity solutions as a substitute for verification. 

In the present note we illustrate these ideas in the simplest framework of linear 
parabolic equations with terminal conditions on the whole state space (a particular 
version of Feynman-Kac). However, we claim that thess ideas carry over to much 
more general frameworks. In particular, other linear cases including infinite hori- 
zons, running-costs, exit times or even refiections on the boundary can be easily 
treated in an identical way. More interestingly, we intend to carry over these ideas 
to the more important case of Hamilton- Jacobi-Bellman equations associated to 
stochastic control and stochastic games (Isaac's equations). These more technical 
details are left to future work and will be presented in forthcoming papers. 

2. The set-up and main results 

Fix a time interval T > and for each < s < T and x e M'* consider the 
stochastic differential equation 

^^-j 1 dXt = b{t,Xt)dt + a{t,Xt)dWt, s<t<T 

We assume that the coefficients b : [0, T] x R"^ ^ R'' and a : [0, T] x M'^ ^ Mrf,d'(R) 
are continuous. We also assume that, for each {s,x) equation llj has at least a 
weak non-exploding solution 

((xr).<*<T,(T4^r)s<*<T,^^^^^-F^^^p^'^(-Fr)s<t<T), 

where the VF" is a d'-dimensional Brownian motion on the stochastic basis 

and the filtration {J^^'^)s<:t<T satisfies the usual conditions. We denote by A"*'^ 
the non-empty set of such weak solutions. It is well known, for example from [4], 
that a sufficient condition for the existence of non-exploding solutions, in addition 
to continuity of the coefficients, is the condition of linear growth: 

\b{t,x)\ + \a{t,x)\ < C{l + \x\), {t,x) e [0,r] X R'^. 
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We emphasize that we do not assume uniqueness in law of the weak solution. 

Remark 2.1. Actually, in order to insure that X^''' is a set in the sense of ax- 
iomatic set theory, one should restrict to weak solutions where the probability space 
VL is an element of a fixed universal set S of possible probability spaces. 

Now, for some fixed bounded and measurable function g : — >■ R, we denote by 
v^{s,x) := inf E'*'^[5(X^'^)], and v*{s,x) := sup E'''=^[5(Xj'^)]. 

We will call the functions v^, and v* the lower and the upper expected pay-offs 
(value functions). It is obvious that 

and the two functions coincide if the stochastic differential equation ([!]) has a unique 
in law weak solution. 

Remark 2.2. At this stage, we cannot even conclude thatv^ andv* are measurable. 

We expect that the expected pay-offs (value functions) and v* be associated 
to the following linear PDE: 

/r,x / -ut - Ltu 

^ ' \ u{T,x)^g{x), 

where the time dependent operator Lt is defined by 

{Ltu){x) = {b{t,x),\/u{t,x)) + ^Tr{a{t,x)a'^ {t,x)u^^{t,x)), 0<t <T, x eR''. 

2.1. Stochastic Perron's method. Let g : R"* — > M be measurable and bounded. 
As mentioned in the Introduction, we now introduce the sets of stochastic super 
and sub-solutions of the parabolic PDE ([2]) in the spirit of 5 . 

Definition 2.1. The set of stochastic super-solutions of the parabolic PDE 
denoted by , is the set of functions u : [0,T] x — > M which have the following 
properties 

(i) are upper semicontinuous (USC) and bounded on [0,T] x . In addition, 
they satisfy the terminal condition u{T, x) > g{x) for all x € W^. 

(ii) for each {s,x) G [0,7"] x M'', and each weak solution 

[ixns<t<T, {wns<t<T, w--,:f--,¥^'-, i^ns<t<T) e x--, 

the process {u{t, X^'^)) s<t<T is a supermartingale on (0^'^,P*'^) with re- 
spect to the filtration {J-f'^)s<t<T ■ 

Definition 2.2. The set of stochastic sub-solutions of the parabolic PDE de- 
noted by lA^ , is the set of functions u : [0,T] x M'' — !■ R which have the following 
properties 

(i) are lower semicontinuous (LSC) and bounded on [0,T] x . In addition, 
they satisfy the terminal condition u{T, x) < g{x) for all x G M**. 

(ii) for each {s,x) € [0,T] x W^, and each weak solution 

((x,^'^),<t<T,(M/t^'").<t<T,f^^'",.F^'",P^^",(-F,^'")s<*<T) e X'^^, 

the process {u{t, X^'^))s<t<T is a submartingale on (51'''^, P'*'^) with respect 
to the filtration {J^t'^)s<t<T- 
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Remark 2.3. In the Definitions \2.1\ \2.S\ of lA^ ,IA^ we do not assume that the 
processes {u{t, Xl'^))s<t<T have (RC) right- continous paths. For this reason, care 
must be taken when one tries to apply the Optional Sampling Theorem in the form 
of "a stopped martingale is a martingale". More precisely, such a theorem holds 
only with respect to discrete-valued stopping times. 

Remark 2.4. Since g is assumed bounded, the sets lA^ and lA^ are easily seen to 
be non-empty. More precisely any constant function u(t, x) = k which is an upper 
bound to g (g < k) is in lA^ and any constant function u(t, x) = k which is a lower 
bound to g (k < g) is in IA~ . If one wants to account for a larger class of functions 
g than bounded, then the definitions oflA^ and should be changed appropriately, 
and an assumption on non-emptiness oflA~ and should be made. 

Using the properties of sub(super)-martingales as well as the definition of and 
V* , we easily obtain the following result. 

Lemma 2.1. For each u G lA^ and each w G we have u < v,, < v* < w. 
Using the Remark 12.41 and Lemma 12.11 we can define 

:= sup u < v^, < V* < := inf vu. 
ueu- weu+ 

Lemma 2.2. We have e lA^ , v+elA^. 

Proof. It is well known that an infimum of upper semicontinous functions is upper 
semicontinuous. While we cannot conclude directly that the point-wise infimum of 
supermartingales is a supermartingale (because the set of supermartingales may be 
uncountable, and the use of essential infimum would be needed), we can appeal to 
Proposition 14.11 in the Appendix and conclude that t;+ is actually the point-wise 

infimum of a countable set of functions Wn G lA^ , n = 1,2 Now, the point-wise 

infimum of a countable set of supermartingales is, indeed, a supermartingale. The 
terminal condition for u+ is satisfied and the boundedness follows easily since g is 
bounded so v* is bounded, and using Remark [23] and Lemma l2. II we have 

V* < < sup g{x). 

Therefore G . The other part is identical. □ 

Remark 2.5. Using Lemma \2.i^ one could easily show that u+ is a viscosity super- 
solution of ([2|) (i.e. satisfies ((8]) below in the viscosity sense) and is a viscosity 
subsolution of Q (i.e. satisfies ([7]) below in the viscosity sense). However, while 
true, this does not present much interest. 

The following is the main technical result of the present note: 

Theorem 2.1. (Stochastic Perron's Method) If g is bounded and LSC then is 
a bounded and LSC viscosity supersolution of 

-ut ~ Ltu > 0, 
u{T,x) > g(x). 

If g is bounded and USC then is a bounded and USC viscosity subsolution of 

-ut - Ltu < 0, 
u{T,x) < g{x). 



(3) 



(4) 
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Remark 2.6. We have v (T,x) < g{x) and v^{T,x) > g{x) by construction. 
Therefore, the terminal conditions in Q and (j4]) can be replaced by equalities. 

Remark 2.7. We would like to point out that the semi- continuous solutions ob- 
tained by Perron's method have the correct semicontinuity needed for such a defi- 
nition. We refer the reader to pi for an introduction to (semicontinuous) viscosity 
sub and super- solutions of second order equations. 

Proof. We will only prove that is a subsolution of Q; the other part is sym- 
metric. 

Step 1. The interior sub-solution property. Note that we already know that u+ is 
bounded and upper semicontinuous. Let 

ip : [0,T] xW^ 

be a C-'^'^-test function function and assume that — ip attains a strict local max- 
imum (an assumption which is not restrictive) equal to zero at some interior point 
{to,xo) e (0,T) X W^. Assume that v'^ does not satisfy the viscosity subsolution 
property, and therefore 

-ipt{to, xq) - Ctvito, Xq) > 0. 

Since the coefficients of the SDE are continuous, we conclude that there exists a 
small enough ball B{to, xq, e) such that 

-ipt - Ct^p > on B{to, Xq, e), 

and 

if > on B(to,xo,e) - {to,XQ). 

Since — ip is upper-semicontintuous and B{to,xo,e) — B{to,xo,e/2) is compact, 
this means that there exist a 5 > such that 

ip - S >v+ on B{to, Xq, e) - B(tQ,XQ, e/2). 

Now, if we choose < 77 < (5 we have that the function 

satisfies the properties 

-p^l - LtpP > on B{tQ, Xq, e), 
ip^ > v+ on B{tQ, Xq, e) - B{tQ,XQ, e/2). 

and 

p''{to,xo) = v+{tQ,xo) - -q. 
Now, we define the new function 

^ f 1;+ A (^'' on B{tQ,XQ,e) , 
\ w+ outside B{tQ,XQ,e). 

We clearly have v'^ is upper-semicontinous and u''(to,a;o) = V''' (^0 , 2^0 ) < v'^{tQ,XQ). 
Also, satisfies the terminal condition (since e can be chosen so that T > tQ + e 
and satisfies the terminal condition). It only remains to show that u'' G W+ to 
obtain a contradiction. For the analytical Perron method on viscosity solution, the 
proof would now be finished, since the viscosity solution property is local and the 
minimum of two supersolutions is a supersolution. In our case, the supermartingale 
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property defining is global so we need to localize it using stopping times. Partic- 
ular care has to be taken since the paths may not be right-continous, so localization 
in general may fail, as pointed out in Remark 12.31 

Fix (s,x) and ((X,^'"),<t<T, (l^/'")s<t<T, P^^^ (^r)s<t<T) e X''\ 

We need to show that the process {v^{t^ X^''^))s<t<T is a supermartingale on (fj*'^, P'''^) 
with respect to the filtration {J^t'^)s<t<T- We first do the proof under the addi- 
tional assumption that the piocess{v'^ {t, X^'^))s<t<T does have RC paths. 

Under this assumption, the process (v^ (t, Xf'^))s<t<T is a supermartingale lo- 
cally in the region [s,T] x K'' — B{to,xo,e/2) because it coincides there with 
the process {v~^ (t, X^'^))g<ct<T which is a RC supermartingale so it can be lo- 
calized. In addition, in the region B{to,xo,e) the process {v'^{t, Xf'^))s<t<T is 
the minimum between two local supermartingales, therefore a local supermartin- 
gale. (It is clear that the process {(p^ (t, X^'^))s<t<T is a local supermartingale over 
B{to,xo,e) by Ito's formula.) Since the two regions [s,T] x R'' — B{tQ,xo,e/2) 
and B(tQ, xo, s) actually overlap over an open region, then we can conclude that 
the process {v^{t, X^'^))s<t<T is indeed a supermartingale. In order to make this 
argument, one needs to choose a double sequence of stopping times reminiscent 
of the optimal strategy in switching control problems. More precisely, the double 
sequence is chosen as the times exiting from B(to, xo, £) and the sequel times en- 
tering B(to, xo, s/2). The choice depends on where the process actually is a time 
the initial time s. 

In general, i.e., if the process {v'^ {t, X^'^))s<t<T does not have RC paths, then 
we can work with its right continuous limit over rational times to reduce it to the 
case above. More precisely, fixO<s<r<t<T and x G R"*. We want to prove 
the supermartingale property for the process {Yu)s<u<t ■= {v^{u, X^''-^))s<u<t 
between the times r and t, which means we want to show that 

(5) > E"'^[yt|j-^'^]. 

First, we make the notation Zu '■= v^{u, X^'^) for r < u < t and we stop it at time i, 
i.e. Zu := ^^{t, X^'^) ior t <u <T. The process {Zu)r<u<T is a supermartingale, 
but may not be RC, as discussed. We can use Proposition 3.14 page 16 in Karatzas 
and Shreve [3 to define the RC supermartingale 

Z+{uj):= lim Zq{uj), uj en*,r <u<T, 

and 

z+ = 0, w ^ n*, 

where P'''^[r2*] = 1. We would like to emphasize that Z"*" is, indeed a RC su- 
permartingale with respect to the original filtration since the filtration is assumed 
to satisfy the usual conditions. Since the function i;+ is USC, and the process is 
constant after t we can conclude (taking path-wise limits) that 

Zr > Z^ , Zt — Zf . 

We recall that in the open region B{tQ,xii,e) — B{to,xo,e/2) we have < — 6. 
Therefore, if we take right limits inside this region, and use the fact that ip is 
continous the we get 



Z+<^''(M,xr), if {u,x:,nEB{to,xo,e)-B{to,xo,e/2). 
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Now, we can define the process 



Y+ := J Zu, {u,X^--)^B{to,xo,e/2), 



We note that we have 

Yr>Y+, Yt^Y+. 

Now, for the process Y'^ , we can apply the previous argument, since has RC 
paths, to conclude it is a supermartingale. In particular, we have that 

Yr > Y+ > E''-'^'[Y+\J'^^^] = E'^^[Yt\J'^-'']. 

Step 2. The terminal condition. Assume that, for some xq G K'' we have 
v~^(T^X()) > g{xQ). We want to use this information in a similar way to Step 1 
to construct a contradiction. Since g is USC on R'', there exists an e > such that 

g{x) < v^{T,xo) - e, \x - xo\ < s. 

We now use the fact that u+ is USC to conclude it is bounded above on the compact 
set 

(B(r,xo,£) - B{T, xo, e/2)) D ([0, T] x R''). 

This was anyway clear, since actually w+ is globally bounded, but the argument 
above shows the proof works in even more general cases. Now, we choose 77 > 
small enough so that 

(6) v+{T,xo) + —>e+ sup v+it,x). 

^ it,x)e{B{T,xo,e)-B{T,xa,e/2))n{[0,T]x'R'^) 

We now define, for k > the following function 

^'^^'•''{t, x) = v+{T, xo) + t^-^ + k{T - t). 

V 

For k large enough we have that 

-^^■''■'^ - A(^='"''= > 0, on B{T,xo,e). 

In addition, using ^ we have that 

^^e,n,k > £ + ^;+^ on {B(T,xo,e) - B(T, xq, e/2)) n ([0, T] x K^). 

Also, (p^'^'^{T,x) > v^{T,xo) > g{x) + e for \x — xo\ < e. Now, we can choose 
6 < £ and define as in the proof of Step 1 



v+ A - 5^ on B(T, Xo, e), 

u+ outside B(T,xo,e). 



We can now prove, using the same switching principle and RC modification argu- 
ment as in Step 1 that v'''''''''^ G U+ , but v"^"^^^^^ {T, x^) = v+{T, xq) - 5, leading to 
a contradiction. □ 
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2.2. Verification by comparison. 

Definition 2.3. We say that the viscosity comparison principle holds for the equa- 
tion ([2]) with respect to time horizon T and the final condition g, or that condition 
CP{T,g) is satisfied if, whenever we have a bounded, upper- continuous (USC) sub- 
solution u of 

-ut - Ltu < 0, 
u(T, x) < g{x), 



(7) 

and a bounded lower semicontinous super- solution v of 
(8) 

then u < V. 



—ut — Ltu > 0, 
u{T,x) > g{x). 



Next theorem is an easy consequence of our main result, Theorem 12. II However, 
it amounts to a verification resuh for non-smooth viscosity solutions of ([2]), so we 
consider it to be the other main result of the present note. 

Theorem 2.2. Let g be bounded and continous. Assume also that the comparison 
principle CP{T, g) is satisfied. Then there exists a unique bounded and continuous 
viscosity solution v to ^ which equals both the lower and the upper pay-offs (value 
functions), which means 



6 X' 



In addition, for each (s, x) G [0, T ] X W^, and each weak solution 

[{Xr)s<t<TAWns<t<T.^'''\T^'\^'^''.{^ns<t<T) 

the process {v{t, X''^'^))s<t<T 'is a martingale on (il^'^, P'*'^) with respect to the 
filtration {J-^'^)s<ct<T ■ 

Proof. The proof is immediate in light of Definition 12. 3[ Lemma l2.5l and Theorem 

□ 

Remark 2.8. The martingale property for {v{t, X^'^))s<t<T 'is proved without us- 
ing the Markov property of the weak solution (which is not even assumed). However, 
if CP{T,g) is satisfied for any T and any hounded (test function) g, then we obtain 
that, for each {s,x) and each T the law of X^^ is uniquely determined. Following 
Theorem 6.2.3 in [A\ or Proposition J^. 27 page 326 in pi, uniqueness of marginals 
implies uniqueness in law of the weak solution. Now, uniqueness in law for any 
{s,x) does imply the Markov property for the weak solution of the SDE ([T]) (the 
Markov property holds with respect to the natural raw filtration though). We refer 
the reader to Theorem 6.2.2 in 4 or Theorem 4-20 page 322 in [3] for the last 
mentioned result. 

Remark 2.9. The whole paper can be rewritten by selecting, for each {s,x), only 
one weak solution X'^'^ instead of using the set of weak solutions A"^^^. Such a 
selection uses the axiom of choice and does not need to be a Markov selection. 
Once the selection X'^'^ is chosen, the sets of stochastic super and sub-solutions 
in Definitions \2.1\ and \2.2\ have to be re-defined accordingly, and there is only one 
pay-off (value function) v replacing and v* . 



STOCHASTIC PERRON'S METHOD 



9 



3. Conclusions 

We designed a stochastic counterpart to Perron's method which produces two 
viscosity solutions of the Feynman-Kac equation. The two solutions squeeze in 
between the expected pay-off, and this comparison is a trivial consequence of the 
probabilistic definition. If, in addition, a viscosity comparison result holds, then 
we do have a unique viscosity solution, which is a martingale along the solutions 
of the stochastic differential equation and is equal to the expected pay-off. In this 
case, we therefore have a full verification result without smoothness of the viscosity 
solution. 

While the Perron method we describe here is reminiscent of the characterization 
of the value function in optimal stopping problems as the least excessive function, 
we would like to point out that here, unlike in optimal stopping, we avoid proving 
that the value function is "excessive" . This is actually the point of verification by 
comparison, to avoid working with the value function. 

One could try to prove directly, avoiding viscosity altogether, that and 
along solutions of the SDE are martingales, i.e. they are stochastic solutions in the 
sense of Stroock and Varadhan 0. However, this is actually not possible: and 
v~ are stochastic solutions only when they coincide, since the stochastic solutions 
are unique by definition. We can additionally justify that, in general, d+ and v~ 
are viscosity solutions but may not be stochastic solutions by observing that the 
stochastic solution property is much stronger then viscosity. Fortunately, in a large 
number of situations, viscosity property is still strong enough to prove uniqueness. 
In this case, viscosity and stochastic solution property are equivalent. 

4. Appendix: Countable selection to achieve the inf/sup of a class 

OF semi-continous functions 

The main purpose of the Appendix is to prove a countable selection argument 
needed in the proof of Lemma 12.11 Let (A/, d) be a metric space and consider a 
class Q of functions / : M — > M. The first result is 

Lemma 4.1. Let g : M M. Then, the following conditions are equivalent 

(i) g{x) — inf/gg ,f{x), for each x £ M, 

(ii) {x G M\g(x) < g} = U/e^{a; G M\f(x) < q}, for each q £ Q. 

Proposition 4.1. Assume that {M,d) is a separable metric space (or, less, a topo- 
logical space with a countable base). Assume also that each function in the class Q 
is upper- semicontinous (USC). Then, there exists a countable subclass of functions 
T-L <ZQ such that 

fAx) inf f(x) ~ inf Hx), for each x G M. 

Proof. Fix a q G Q. According to Lemma [4.11 the open set {x G A/|/,(x) < g} 
admits an open cover as 

{x G M\f,{x) <q}^ U/eg{.T G M\f{x) < q}. 

Since the space (M, d) is separable, so it admits a countable basis, one can select 
a countable open sub-cover. More precisely, there exists a countable Qq <Z Q such 
that 

{x G M\f,{x) < g} = U/eeJx G M\f{x) < q}. 
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Now, we define the countable class 

We have, for each q <E Q that 

{x e M\Uix) <q}^ U/egJx e M|/(x) < q} C Ufeuix £ M\f{x) < q} 

C {x e M\U{x) < q}. 

According to Lemma HTTl we then have that 

f*(x) = inf fix), for each x G M. 
^ ' feu ^ ' 

□ 

Remark 4.1. We would like to point out that in the argument of selecting a count- 
able open sub-cover the axiom of choice is used. 
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